Oracle Inequality for Instrumental Variable Regression
نویسندگان
چکیده
where φ is the parameter of interest which models the relationship while U is an error term. Contrary to usual statistical regression models, the error term is correlated with the explanatory variables X, hence E(U |X) 6= 0, preventing direct estimation of φ. To overcome the endogeneity of X, we assume that there exists an observed random variable W , called the instrument, which decorrelates the effects of the two variables X and Y in the sense that E(U |W ) = 0. It is often the case in economics, where the practical construction of instrumental variables play an important part. For instance [CIN07] present practical situations where prices of goods and quantity in goods can be explained using an instrument. This situation is also encountered when dealing with simultaneous equations, error-in-variable models, treatment model with endogenous effects. It defines the so-called instrumental variable regression model which has received a growing interest among the last decade and turned to be a challenging issue in statistics. In particular, we refer to [HN91], [NP03] [Flo03] for general references on the use of instrumental variables in economics while [HH05], [DFR03] and [FJvB07] deal with the statistical estimation problem.
منابع مشابه
The Adaptive Lasso Method for Instrumental Variable Selection
Adaptive lasso is a weighted `1 penalization method for simultaneous estimation and model selection. It has oracle properties of asymptotic normality with optimal convergence rate and model selection consistency. Instrumental variable selection has become the focus of much research in areas of application for which datasets with both strong and weak instruments are available. This paper develop...
متن کاملTensor Regression Meets Gaussian Processes
Low-rank tensor regression, a new model class that learns high-order correlation from data, has recently received considerable attention. At the same time, Gaussian processes (GP) are well-studied machine learning models for structure learning. In this paper, we demonstrate interesting connections between the two, especially for multi-way data analysis. We show that low-rank tensor regression i...
متن کاملIdeal Spatial Adaptation by Wavelet
With ideal spatial adaptation, an oracle furnishes information about how best to adapt a spatially variable estimator, whether piecewise constant, piecewise polynomial, variable knot spline, or variable bandwidth kernel, to the unknown function. Estimation with the aid of an oracle ooers dramatic advantages over traditional linear estimation by nonadaptive kernels; however, it is a priori uncle...
متن کاملIdeal Spatial Adaptation by Wavelet Shrinkage
With ideal spatial adaptation, an oracle furnishes information about how best to adapt a spatially variable estimator, whether piecewise constant, piecewise polynomial, variable knot spline, or variable bandwidth kernel, to the unknown function. Estimation with the aid of an oracle o ers dramatic advantages over traditional linear estimation by nonadaptive kernels; however, it is a priori uncle...
متن کاملOptimal Rates for Regularized Least Squares Regression
We establish a new oracle inequality for kernelbased, regularized least squares regression methods, which uses the eigenvalues of the associated integral operator as a complexity measure. We then use this oracle inequality to derive learning rates for these methods. Here, it turns out that these rates are independent of the exponent of the regularization term. Finally, we show that our learning...
متن کامل